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ABSTRACT 

A  transformation  procedure  is  presented  for  converting  rule-based  systems  with  nonlinear 
constraints  into  nonlinear  optimization  problems.  The  transformation  procedure  is  then  applied  to 
an  illustrative  site  identification  system.  Nonlinear  optimisation  problems  are  constructed  both  for 
the  subset  of  rules  consisting  only  of  lo^cal  predicates  and  for  the  complete  system.  Experimental 
results  obtained  by  solving  the  nonlinear  optimization  problems  for  the  site  identification  system 
yield  a  complete  description  of  valid  variable  bindings  for  all  rules  in  the  system. 

This  procedure  was  developed  in  response  to  the  need  t'  solve  logical  deployment  problems  for 
the  U.S.  Army.  In  this  application  dom^,  numerical,  geometric,  and  geographic  constr^ts  must 
be  incorporated  with  lopcal  constraints  in  a  uniform  framework  as  in  human  inference.  Rules  in  the 
system  must  be  able  to  express  various  types  of  relationships,  including  relationships  in  the  form  of 
nonlinear  constraints.  Modeling  rule-based  systems  as  nonlinear  optimimization  problems  provides 
a  powerful,  uniform  framework  with  the  flexibility  to  handle  mixed  data  types  and  numerical  and 
geometric  relationships. 

1.  INTRODUCTION 

A  potentially  useful  way  of  organizing  the  massive  volume  of  information  available  from 
multiple  sensors  with  human  expertise  and  decision-making  criteria  is  through  facts  and  rules 
that  can  be  accessed  by  expert  systems.  In  these  systenu  numerical,  geographical,  and  geometric 
information  must  be  combined  uniformly  with  lopcal  information  as  in  human  inference  to  answer 
queries  and  solve  problems.  The  rules  in  the  system  must  be  able  to  express  various  types  of 
relationships,  including  constraint  relationships  containing  variables  which  must  satisfy  both  lo^cal 
and  numerical  relationships. 
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Previous  work  in  this  area  includes  the  development  of  the  class  of  Constraint  Logic  Program¬ 
ming  (CLP)  languages,  due  to  Jaffar  and  Lasses.*  CLP(R),  a  constraint  programming  language 
over  the  domain  of  real  numbers,  solves  linear  constraints  by  generalising  unification  and  solves 
nonlineair  constraints  by  delaying  the  solution  until  a  sufiicient  number  of  variables  have  been  solved 
to  reduce  the  nonlinear  constraints  to  linear  constr^ts.  In  CLP(M),  a  constraint  programming 
language  for  solving  optimization  problems,  the  "ConstrainedMin”  and  “ConstrainedMax”  routines 
in  Maihematica  are  used  to  solve  embedded  optimisation  problems. 

A  mixed  integer  linear  prc^amming  methodology,  in  contrast  to  unification  and  resolution, 
was  developed  by  Bell  et  al.  ^  to  perform  deduction  (compute  stable  models)  at  compile-time  in¬ 
stead  of  run-time.  Using  this  approach,  run-time  query  executions  can  be  performed  by  traditional 
database  “select/project/join”  operations.  The  authors  provide  experimental  results  demonstrating 
the  efficiency  of  the  approach  compared  to  standard  Prologs.  They  also  point  out  that  the  exis¬ 
tence  of  incremental  algorithms  for  solving  linear  programs  suggests  that  the  linear  programming 
methodology  for  compile-time  deduction  may  be  very  efficient  when  performing  system  updates. 
Other  advantages  of  this  methodology  mentioned  by  the  authors  are  that  the  ordering  of  rules  and 
antecedents  in  the  system  will  not  affect  the  results  and  that  queries  will  always  terminate. 

In  this  paper,  we  concentrate  on  performing  deduction  in  rule-based  systems  using  a  nonlinear 
optimisation  nethodology.  The  systems  under  consideration  contain  rules  which  require  the  sat¬ 
isfaction  of  geometric  constraints  in  conjunction  with  logical  constraints.  Fbcts  and  rules  in  the 
systems  describe  terrain  characteristics  and  terrain  reasoning  coupled  with  decision-making  criteria. 

A  transformation  procedure  is  developed  for  mapping  the  rule-based  system  with  geometric 
constraints  into  a  nonlinear  optimisation  problem  which  can  be  solved  either  at  compile-time  or  at 
run-time.  Domain  information,  facts,  rules,  and  couplings  between  logical  predicates  and  geometric 
constraints  are  uniformly  represented  as  nonlinear  constraints  which  are  positive  for  invalid  solu¬ 
tions  (deductions)  and  zero  for  valid  solutions.  The  procedure  is  described  for  an  illustrative  site 
identification  system  and  experimental  results  of  solving  the  corresponding  nonlinear  optimisation 
problem  are  presented. 

The  remainder  of  the  paper  is  organized  as  follows.  Section  2  describes  the  transformation 
procedure  and  introduces  the  illustrative  site  identification  system.  Section  3  discusses  experimental 
results  obtmned  by  solving  nonlinear  optimization  problems  associated  with  the  site  identification 
system.  Conclusions  and  recommendations  for  future  research  are  outlined  in  Section  4. 


2.  TRANSFORMATION  PROCEDURE 


The  goal  of  the  transformation  procedure  is  to  map  deductive  systems  with  geometric  con¬ 
straints  into  combinatorial  optimization  problems.  Combinatorial  optimization  problems  can  be 
defined  as  the  class  of  problems  which  deal  with  maximising  or  minimising  a  function  of  many  ^ 
variables  subject  to  inequality  and  equality  constraints  and  integrality  restrictions  on  some  or  all 
of  the  variables.  We  will  be  concerned  with  the  equality-constrained  optimization  problem  1 


minimize  /(>)• 
subject  to  fi(s)  =  0, 
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where  /  :  R"  -»  R,  h  :  R**  -»  R"*  and  /  and  g  are  nonlinear  fhnctiona. 

Variable-free  mlee  are  converted  into  equivalences  by  noting  that  if  there  are  two  or  more  roles 
with  the  same  consequent,  they  can  be  combined  as  below,  i.e. 

Ri,i  and  Bi,2  and  •  •  •  and  -*  A 
Bk,i  and  Bk,2  and  •  *  •  and  Bh  m.  -*  A 

can  be  rewritten  as 


(Rt,i  and  Bi,2  and  •  •  •  and  Bi,n)  or  •  •  •  or  (Ra,i  and  and  •  •  •  and  *-*  A 


In  essence,  this  step  of  the  transformation  procedure  computes  the  completion  of  the  ground  version 
of  a  logic  program  as  outlined  in  Bell  et  aL^ 

Foi  the  site  identification  system  in  Figure  1  below,  the  results  of  the  first  step  of  the  transforma¬ 
tion  for  the  rules  existing^onstruciion(a,  b),  possMeJbuUdingjtite^a,  b),  and  possiblejrestaurani 
_j»te(a,  b)  are  respectively 

existingjconstTiieiion(a,  6)  ehemieal4ilant{a,  b)  or  house{a,  b)  or  interstate{a,  b).  (2) 

possible JfuildingMte{a,b)  «-»  flaijterrair^a,b)  and  (not  existing-eonstrueium(ayb)),  (3) 

possible jrestaurantMte{X,Y)  *-*  possibleJbuildingMte{X,Y)  and  X  >  3  and  V  >  3  ..v 

and  (distance  £rom  (ir,y)  to  (5,5)  <  1.2)  '  ' 

where  a  and  6  are  constants  obt^ed  by  substituting  one  of  the  values  1,2, 3, 4, 5  for  X  and  Y. 

The  next  step  in  the  procedure  is  to  construct  constraints  on  solutions  to  the  nonlinear  opti¬ 
misation  problem  to  represent  the  facts  in  a  rule-based  system.  Each  fact  and  also  each  lo^cal 
predicate  appearing  in  the  variable-free  form  of  the  system  is  associated  with  a  real  variable  in 
the  range  [0, 1]  with  0  denoting  a  "true”  predicate  and  1  a  Talse”  predicate.  For  each  fact,  /,  a 
construnt  of  the  form  F  =  0  is  constructed  (where  F  is  the  variable  associated  with  the  fact  /). 

Domain  constrwts  are  also  imposed  on  the  values  of  the  assodated  variables.  In  order  to 
ensure  that  the  value  of  each  associated  variable  will  be  dther  ‘Hrue”  or  Talse”,  constraints 
of  the  form  F(1  -  F)  =  0  must  be  included  for  each  variable  associated  with  a  lo^cal  predi¬ 
cate.  For  the  site  identification  system  (with  the  exclusion  of  the  last  rule),  there  are  a  total  of 
175  domain  constraints.  Each  of  the  seven  predicates  in  the  program,  i.e.eheinieal^ant(X,  Y), 
/laUerrain(X,Y),  house(X,Y),  inter state(X,Y),  lake(X,Y),  existing jConstruetiof^X,Y),  and 
possibleJniildingjsite^X,  Y),  expands  into  25  predicates  in  the  variable-free  version  of  the  system 
when  the  values  1  through  5  are  substituted  for  X  and  Y. 

Logic  constraints  are  represented  by  equating  to  sero  functions  which  are  non-sero  for  invalid 
combinations  of  truth  values  and  sero  for  valid  sets  of  truth  values.  The  functions  constructed  to 
enforce  the  logic  constraints  were  formed  by 
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1.  entunerating  a&  invalid  combination!  of  truth  valnef  for  rule!  which  had  been  tranifonned 
iuto  equivalence  rdiations, 

2.  associating  a  truth  value  of  "true”  to  a  term  of  the  form  (1  -  v)  and  a  truth  value  of  "false” 
to  a  term  of  the  form  v,  and 

3.  multiplying  together,  for  each  invalid  combination  of  truth  values,  the  associated  terms. 


fVicts  for  Site  Identification  System: 
chenuoal.pIant(2, 2). 

flatJerrain(l,l).  flatjlerrain(l,2).  fUUJerram(l,i).  flatJerrain(2,l).  ftaLterrain(2,2). 

/iat.terrasn(2, 3).  /iat_terrawi(2, 4).  ftat-ierrau^2,l).  /IatJerram(S,  2).  /lalierratn(3, 3). 

flaLierTain(4,l).  flat.ierrain(4,2).  flatjUrrair^4,4).  /lot  Jerra«n(4, 5).  flatjUrrain(S,2). 
flatJterrair^S,  3).  flat.terrair^S,  4).  flatjterrain(J&,  5). 

Aou«e(l,4).  hoiise(l,S).  houM(2,5). 

inter*Utte(S,  S). 

iaJke(S,  1). 

Rules  for  Site  Identification  System 

exittingjcanttnuiion(X,  Y)  *—  ehemical.planl{X,  Y). 

exittingjeanHrvetian{X,Y)  *—  hou$e{X,Y). 

exiHingjoonttru^ian^X,  Y)  *-  int€rttate(X,  K). 

pottMe.buiUiing.gite(X,  Y)  «—  flatJterram{X,  Y)  and  (not  exuUngMnttrvetian(X,  Y)). 

poanUe.re9Umrantjite{X,Y)  *—  poss«Ue.ftiuldiny-s«te(X,y)  and  X  >  3  and  y  >  3 

and  (distance  from  (ir,y)  to  (5,5)  <  1.2) 

Figure  1:  Site  Identification  System 


This  general  procedure  of  constructing  a  system  of  nonlinear  constraints  to  represent  logic 
constraints  is  illustrated  below  for  the  rule  given  in  equation  2.  The  following  notation  will  be 
used.  Associated  with  predicates  existingje<mstrvciion{a,b),  ehemieal^ant{a,b),  house{a,b), 
inter state(a,b),  posMleJbuildingMte(a,b),  and  flatJerrain(a,b)  are  the  variables  E^jk,  C^jk, 
Bajbi  and  Fajb,  respectively.  Note  that  for  equation  2,  the  invalid  sets  of  truth  com¬ 
binations  for  are  {t,f4^4},  {f,t,t,t},  {f,t,t/),  {f,t/,t},  {f,t,f4},  {V,t,t>,  {f^t/}. 

and  {f4^tf|t}  where  "t”  denotes  "true”  and  "f”  denotes  "false”.  The  corresponding  constraints  for 
existingjeonstrueiion(a,  b)  are  ^ven  below: 


4 


Logic  Constraints  for  existing-construetion(a,b) 

(1  -  =  0 

E.J,{1  -  C.^)(l  -  F.>)(1  -  /.>)  =  0 

Emjk(l  -  C»jk)H^tjk  =  0 

E^C^il  -  E^)I^  =  0 
—  Imjk)  —  0 


Numeric  and  geometric  constraints  embedded  in  ntles  are  treated  analogously  to  logical  re¬ 
lationships.  During  the  process  of  substitution  of  values  for  variables  in  the  first  stage  of  the 
procedure,  several  simplifications  may  be  directly  applwd.  Fbr  example,  in  the  site  identification 
system,  possible  sites  considered  for  a  restaurant  may  be  limited  to  those  sites  where  X  and  Y  are 
both  greater  than  3.  This  means  that  there  are  posribly  four  rites,  rites  (4, 4),  (4, 5),  (5, 4),  and 
(5, 5}  which  need  to  be  considered  in  the  formulation  of  the  optimisation  problem.  All  possible 
truth  combinations  for  the  rule  for  posnbtej’estawant^te  were  then  considered.  The  inequality 
constraint  that  the  distance  between  a  possible  restaurant  rite  and  the  rite  (5,5)  where  the  inter¬ 
state  was  located  must  be  less  than  1.2  was  turned  into  an  equality  constraint  by  adding  a  slack 
variable.  Thru,  the  distance  condition  inequality  d((a,5),(5,5))  <  1.2  became  a  distance  condition 
equality  of  the  form 


d((o,  6),  (5, 5))  -  1.2  -H  slodk(o,  6)  =  0 

where  s/adk(a,  6)  is  the  slack  variable  assodated  with  d((a,  6),  (5, 5)).  Let  us  denote  the  square  of  the 
expression  on  the  left-hand  ride  of  the  equality  in  equation  5  above  as  Whenever,  in  one  of 

the  invalid  sets  of  truth  combinations,  the  truth  value  for  the  distance  condition  evaluated  to  "false’*, 
Dis^j^  was  inserted  into  the  associated  optimisation  constraint  product.  When  the  truth  value 
for  the  distance  condition  was  "true”,  a  desirable  function  for  the  assodated  term  in  the  product 
would  have  the  property  of  being  close  to  sero  when  the  distance  condition  was  not  satisfied  and 
non-sero  if  the  distance  condition  was  satisfied.  A  function  which  we  have  used  in  our  experiments 
is  l/{l  +  ezp(Dis^j^)).  Using  this  function,  the  logic  constrrints  for  possiblejrestaurant^te  were 


Logic  Constraints  for  possible-restaurant-site 

(1 -«.*)(! =  0 

iMl  -  =  0 

where  anfi  Pmjk  the  variables  associated  respectively  vrith  possMejreataurantsiU  and 
posMbleJuUding.site{a,  h). 
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If  the  Mmple  logic  program  had  consisted  only  of  lo|pcal  information,  the  objective  function  to 
be  minimised  would  have  been  simply  the  negative  of  the  sum  of  the  logical  variables.  Minimising 
the  negative  of  the  sum  of  variables  that  assume  the  value  1  if  false  (and  0  if  true)  means  that 
unless  explicitly  told  by  the  facts  or  the  rules  in  the  lo^c  program  that  a  particular  ground  atom 
(assumption)  is  true,  one  is  to  assume  that  it  is  false.  There  is  no  guarantee  that  there  is  a  unique 
optimal  solution  to  this  problem  or  that  all  solutions  are  optimal  solutions.  For  further  details, 
reference  can  be  made  to  the  discussion  on  computation  of  minimal  models  in  Bell  et  al.^ 

When  the  lo^c  program  consists  of  geometric  as  well  as  lo^cal  information,  the  form  of  the 
objective  function  is  more  complex.  For  the  site  identification  system,  the  objective  function  /(^ 
which  was  to  be  minimised  consisted  of  the  negative  of  the  sum  of  179  variables  added  together 
with  the  sum  of  four  variables  of  the  form 


S.  EXPERIMENTAL  RESULTS 

A  standard  approach  to  solving  a  construned  nonlinesir  optimisation  problem  is  to  solve 
an  equivalent  unconstrained  minimisation  problem.  The  unconstr^ed  problem  typically  involves 
minimising  a  function  consisting  of  the  sum  of  the  original  objective  function  and  a  weighted  sum 
of  non-negative  constraint  terms  called  a  penalty  function.  The  penalty  parameter  (coefficient)  is 
adjusted  during  the  course  of  the  convergence  procedure  to  guarantee  convergence  to  a  feasible 
solution. 


Recurrent  neural  networks  with  time-varying  penalty  parameters  as  described  by  Wang^  were 
used  in  this  study  to  find  solutions  for  the  Site  Identification  System.  The  first  task  in  the  devel¬ 
opment  of  a  recurrent  neural  network  for  solving  an  optimisation  problem  is  to  design  an  energy 
function  whose  minimum  represents  the  solution  to  the  optimisation  problem.  Let  us  assume  that 
the  optimisation  problem  can  be  formulated  as  a  nonlinear  programming  problem  with  a  single 
objective  function  /(^  in  which  the  goal  is  to 

minimise  /(if)  subject  to  the  constraint  p(^  =  0 
An  energy  function  can  be  defined  as 


where  the  penalty  function  p(iO  is  assumed  to  be  a  non-negative,  differentiable  function  which 
is  equal  to  sero  if  and  only  if  is  a  feasible  solution  to  the  optimisation  problem.  The  penalty 
parameter  X{t)  is  assumed  to  be  a  positive,  monotonically  increasing  function  of  t.  A(t)  is  initialised 
to  a  low  value  and  increased  slowly  to  avoid  numerical  instability  and  overpenalisation.  The  function 
which  was  used  for  A(t)  was 


t 


m  =  E 

r=0 


P{^‘r))cx 


Experiments  were  conducted  using  the  neural  network  approach  on  the  Site  Identification  Sys¬ 
tem  for  (1)  a  nonlinear  optimisation  problem  with  175  variables  obtained  by  applying  the  trans¬ 
formation  procedure  to  the  system  with  the  exclusion  of  the  possiblejrestawant^ite  rule  and 
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for  (2)  a  nonlinear  optimisation  problem  with  182  variablet  obtained  by  using  the  transformation 
procedure  on  the  full  version  of  the  system.  Convergence  to  a  correct  solution  was  obtained  af¬ 
ter  only  three  iterations  for  the  first  optimisation  problem.  The  twenty-five  variables  associated 
with  the  existing -construction  rule  in  equation  2  and  the  twenty-five  variables  associated  with  the 
possibleJniildingsite  rule  of  equation  3  were  correctly  identified  as  0  for  “true”  and  1  for  “false”. 
For  the  second  optimisation  problem,  convergence  was  obtained  in  under  10,000  iterations  to  the 
correct  solution. 


4.  CONCLUSIONS  AND  FUTURE  DIRECTIONS 

This  research  has  provided  a  design  methodology  for  executing  queries  to  rule-based  systems 
contuning  both  lo^cal  and  geometric  constrwts.  A  particularly  innovative  aspect  of  our  approach 
is  the  encoding  of  logical  information  with  geometric  constraints  as  a  nonlinear  optimisation  prob¬ 
lem.  The  feasibility  of  the  approach  has  been  demonstrated  on  a  small,  but  realistic  example.  The 
conclusion  reached  is  that  this  method  has  the  potential  to  compute  fast  and  efficient  solutions  to 
logical  deployment  problems  and  that  it  should  be  the  subject  of  more  investigation  in  order  to 
realise  its  full  potential  in  real-world  applications. 

Future  research  directions  include  extension  to  full-fledged  hybrid  knowledge  bases.  Methods 
need  to  be  developed  to  process  queries  to  logic  programs  which  handle  classical  and  non-monotonic 
negation,  reasoning  about  time,  and  reasoning  about  uncertunty  in  the  context  of  nonlinear  opti¬ 
misation  methodology.  Finally,  more  understanding  is  needed  of  the  complex  interactions  of  the 
new  method  as  it  is  embedded  in  the  battlefield  situations  for  which  it  is  designed.  Deployment  of 
any  one  asset  on  the  battlefield  is  le^timately  studied  in  isolation  in  order  to  delineate  its  precise 
characteristics  and  the  characteristics  of  the  site  it  requires.  But  in  practice  it  may  be  necessary 
to  optimise  everything  simultaneously  in  order  to  express  the  real  situation  where  the  various 
battlefield  assets  are  competing  for  prime  locations. 
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